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Summary 



Areas of research investigated in this report, which is a supplement 
to Final Report OE 5-10-050, include the continued development of a 
computer- assisted instruction program in mathematics and initial reading at 
the Brentwood Elementary School, a new investigation of computer-based 
instruction for spelling at Costano Elementary School, and the initiation 
of a CAI program in elementary- school mathematics for children in rural 
Kentucky through provision of necessary teletype equipment and drill-and- 
practice curriculum materials. 



Mathematics and Reading 



The theory of individualized instruction developed at Brentwood through 
experimentation with the mathematics and reading programs can, with proper 
constraints, be generalized to other programs such as elementary science 
and beginning work in foreign languages. This theory of instruction attempts 
to optimize the learning situation by manipulating variables such as content, 
nature and sequence of presentation, to provide the best learning environment 
for each individual child. To achieve individualization, a means for 
determining the best future program of instruction for each child based 
on the history of his past responses was required. Presentation of 
materials for each child was controlled by correctness of his past responses, 
the length of time he took to make them, and the nature of his past learning 
patterns. A more detailed statement of plans of the Brentwood part of the 
contract may be found in the conclusions given as part of Final Report 
OE 5-10-050. 



Spelling 



A new experiment designed to investigate how computer-based spelling 
should be taught and to gain insight into how spelling and similar verbal 
tasks were learned was started. Concurrently, techniques for optimal 
individualization for both lesson content and student feedback to increase 
the influence of the child's response history on instruction were to be 
examined. 



Morehead, Kentucky 



In May 1967, 30 teletypes were delivered to Breckenridge School (a 
laboratory school at Morehead State University, Kentucky) and 2 teletypes 
were delivered to Elliotsville School, Morehead, Kentucky. Supporting 
teletype equipment for both Morehead and Stanford was included. By 
June 19, 1967, routine on-line drill and practice in elementary mathematics 
began. There was not sufficient time during the period of the contract to 
make a behavioral evaluation of student performance. The primary purpose 
of the project was to attempt the installation of a system such as this in 
a rural area. Thus, the problem was one of operational rather than 
behavioral feasibility. The experience of the several months of operation 
indicated that there were no really different problems encountered in 
operating in a rural area rather than an urban area. Certainly, the student 
response was at least as positive, if not more so. 
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Chapter 1 



Introduction 



On June 29, 19 66, the Institute for Mathematical Studies in the 
Social Sciences received a contract from the Uo S 0 Office of Education 
to continue and supplement the "work begun under Contract OE 5"10"050« 
The objective of the first contract "was to develop and implement a 
computer- assisted instruction (CAl) program in mathematics and initial 
reading. Professor Patrick Suppes continued as principal investigator 
for the mathematics program and Professor Richard Co Atkinson for the 
initial reading program. Development of lesson materials for both 
mathematics and reading and the development of the system continued, 
each having a decided influence on the other . 



Comparing tutorial instruction with the drill- and-practice and the 
dialogue systems of computer-assisted instruction, the tutorial mode 
falls in the middle. The dr ill- and- practice program presents a fixed, 
linear sequence of problems. Student errors are corrected in a. variety 
of ways (e.g. , a prompt response is given in the form of a partial 
answer, or the entire correct response is furnished following an error). 
No real-time decisions are made, however, for introducing unique teaching 
strategies or instructional materials on the basis of a student response. 
The dialogue system provides the richest possible student- system 
interaction. The student is free to construct unrestricted natural- 
language responses, asK questions, and in general, exercise almost 
complete control over the sequence of learning events. 



The tutorial system has the capability for real-time decision-making 
and instructional branching, contingent on a single response or on some 
subset of a student's response history. Students follow separate and 
diverse pathways through the curriculum based on their individual 
performance patterns. The probability is high in a tutorial program 
that no two students will encounter exactly the same sequence of lesson 
materials. Student responses, however, are somewhat limited since they 
must be chosen from a prescribed set of responses or constructed in such 
a manner that relatively simple text analysis will be sufficient for 
their evaluation. The Stanford CAI program in initial reading and 
mathematics is tutorial in nature. 



1.1. CAI as a Tool for Teaching 



The theoretical basis of CAI is that immediate reinforcement 
facilitates learning. The Stanford CAI program provides immediate 
feedback through reward messages, through the presentation of the next 
problem, and through "wrong- answer" messages. 



When the Stanford-Brentwood CAI project was initiated, the common 
criticism and fear heard from educators and lay citizens alike was that 
computers would replace teachers and dehumanize teaching. After the 
first year of operation, however, the comments gradually changed from 
those of apprehension and criticism to those of acceptance, because the 
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system demonstrated that it is practical to individualize instruction# 

If there is any one fact that has been thoroughly established in 60 years 
of intensive investigation in education, it is that a wide range of 
individual differences will be found in any classroom on any dimension 
one wishes to examine. CAI offers the tool for tailoring instructional 
procedures to these individual differences# 

1.2. CAI as a Tool for Research 

The two factors that render CAI useful as a tool for research are 
(a) the control of independent variables; and (b) the detailed response 
data recorded by the system. Our Laboratory achieved a degree of control 
of environment and presentation that was impossible heretofore in a 
classroom setting. The immediate environment of each student's response 
terminal was precisely the same as every other student's# Chairs and 
machines were identical for all students. Every picture seen on the 
projection device, every bit of orthography or other display on the scope, 
and every audio message which the student heard were specified previously 
and were standardized or varied as the experimenter desired. This is not 
to say, of course, that all sources of variation were controlled. The 
CAI facility did achieve, however, a degree of control equivalent to that 
of the psychologist's learning research laboratory. Many problems in 
learning theory which have been investigated Rigorously only in a 
laboratory setting can now be looked at in an: on-going school contexta 

The collection of fine-grained response data is the second capability 
of CAI which is extremely important for research. For example, each 
response made by each student was recorded on data tapes. Each response 
record included a complete description of the response in terms of 
coordinates taken from the face of the scope or the keys depressed on the 
typewriter. The response was defined as correct or incorrect; if it was 
correct, it was categorized according to the type of error made. The 
response latency was recorded in tenths of a second. The contents of 31 
counters and 32 switches associated with the student's past history of 
performance were also recorded with each response on the data tape. 

Testing mathematical learning models in a closer approximation to 
actual classroom learning thairhas existed in the past is another 
important use Of CAI as a research tool# Typically, such models have 
been tested through infra- organism behavior or through contrived tasks, 
such as paired- associate list learning or probability learning# The kind 
of sequential response data gathered at the Brentwood facility will be 
used in the development of optimization models for learning (Groen and 
Atkinson, 1966 i 1 Atkinson and Shiffrin, 1967 2 )# 



^roen, G. , & Atkinson, R. C. Models for optimizing the learning 
process# Psychol # Bull # , 1966, 66 , 309-320# 

^Atkinson, R. C., & Shiffrin, R, M. Human memory? A proposed system 
and its control processes. In K# W„ Spence & J. T. Spence (Eds#,), The^ 
psychology of learning and motivation ? Advances in re search and theory , 
Vol# 2. New*York? Academic Press, 1968# Pp# 89-195 0 
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1.3. CAI as a Tool for Curriculum Evaluation 

The performance data gathered in the CAI system was examined at 
all levels- -from the perspective of overall goals or from the perspective 
of the various strategies and approaches adopted in the curriculum. 
Responses to blocks of homogeneous problem types, responses to separate 
problem types, and responses to the individual problems themselves were 
examined in great detail. Student performance records were examined to 
see if a particular section, level, or item of the curriculum was 
functioning in the manner for which it was designed. It is at this 
detailed level that CAI exhibits its greatest power for evaluation. 





Chapter 2 
Methods 



2.1. The Population 

During the school years of 1966-67 and 1967-68, the first and second 
graders at the Brentwood School, as well as some kindergarten children 
and fourth graders, participated in the Stanford CAI Project. The 
Brentwood School used an ungraded program based on a level system. 

In 1966-67, there were four first-grade classrooms at Brentwood, two of 
which (49 students) received instruction in mathematics under computer 
control and two of'which (56 students) received computer instruction in 
initial reading. All first graders were included in the program. During 
the year of 1967-68, four second-grade levels (72 students) received 
computer instruction in mathematics and four first-grade levels (80 
students) received CAI instruction in reading. Thus, half of the second 
graders continued computer-assisted instruction in mathematics for a 
second year. 

2.2. Stanford-Ravenswood School District Cooperative Plans and Teacher 
In-service Training 

A serious attempt, begun in 1965-66, was made by members of the 
Stanford Project to prepare the teachers and parents of the Ravenswood 
District, and of the Brentwood School in particular, for the acceptance 
of the technological innovation of a computer- assisted instructional 
laboratory. Meetings which initiated intensive interaction between 
project staff and school district personnel continued throughout the summer 
of 1966 with a two-week workshop that was held on the Stanford campus 
for the two teachers who were directly involved in the reading program- 
and continued into the fall with weekly planning groups. 

A six-week workshop was held during the summer of 1967 > i n whicn 
four teachers from the Brentwood School, Mrs. Joan Brewer, Mrs. Vera Boyson, 
Mrs, Louise Ahern, and Mrs. Patricia Nordseth, acted as consultants o 
develop activities that would coordinate their classroom program with 
that of the Laboratory. 



Weekly meetings, including teachers and project personnel, were 
held to evaluate student j progress on the system and to exchange views 
and information about classroom and laboratory instruction, and the 
performance of the students in both environments. 



A member of the Stanford staff was placed permanently at the 
Brentwood School as a school- affairs liaison officer. His duties included 
the resolution of any organizational problems that arose within the 
Brentwood School. He also conducted tours for visitors who visited the 

Laboratory. 
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The preparation and effort expended to establish school- project 
cooperation paid off handsomely. The enthusiasm and support of the 
teaciers was highly gratifying. We held many exhibits, open houses, and 
discussion groups for the parents of the Brentwood School and the patrons 
of the Ravenswood School District. Again, the support of the parents, 
the school hoard, the administration and the teachers exceeded all 

expectations, 

2„3. Description of System 

An IBM 1500 CAI system was designed and constructed by IBM engineers 
in close collaboration with Stanford personnel. The student response 
terminals consisted of a cathode-ray tube (CRT), a modified typewriter 
keyboard, a light pen, a film projection device, and a set of earphones 

with an attached microphone. 

The 16 student- response terminals were serviced by an IBM 1^00 
Process Control computer. This central processing unit had a relatively 
limited (i.e., 32K) immediate access core storage. Rapid access bulk 
storage was provided by six interchangeable disk drives; each disk # 

contained 512,000 l6-bit words. The audio component of the system consisted 
of a b^k of^BM 1505 audio units. Each audio drive unit was connected 
to one of the response terminals, but the connections were varied at will. 
Response data flowing into the system from the student terminals was 
recorded on two IBM 2402 tape units. An IBM 1501 station control, a 
1442 card reader punch and a 1443 line printer completed the configuration 
of the IBM 1500 CAI system. This configuration is shown in Figure 1. 

The IBM 1500 CAI system was a time- sharing system in the sense that 
activities at each student response terminal were examined in sequence 
and appropriate actions taken. The time-sharing was not strictly 
sequential since certain priority conditions within the instructional 
system could preempt the sequence of programmed instructions. 

The entire process moves at a very rapid rate. Subjectively, the 
student at the terminal feels he has the full attention of the system. 

The response time for the CRT was less than 1 second and the projector 
response was nearly as fast. The audio response time was somewhat slower, 

ranging from 2 to 4 seconds on the average. 

The Laboratory was housed in a rectangular, prefabricated steel 
structure approximately 3,200 square feet in area on the Brentwood School 
grounds and contained a terminal room, an off-line teaching room, the 
central computer room, and a group of offices for the Laboratory personnel. 

The staff of the Stanford-Brentwood CAI Laboratory consisted of 
10 members. The Laboratory was under the general management of a senior 
programmer who was also in charge of the data reduction staff. His staff 
included 2 programmers, 2 graduate students and a secretary who also 
functioned as a receptionist. The systems group was headed by another 
senior programmer who had on his staff an assistant programmer and a 
compute? operator, plus a technician who handled audio assemblies. 
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The codins sroups for both the mathematics and the reading programs were 

S e so housfdTn ?he Laboratory. The mathematics and read ng cod ng groups 

were directed by a senior lesson programmer and consisted of 4 coders, 

plus part-time debuggers and graduate assistants, Proctors sup off-line 

?he children in the terminal room itself and were responsible for off-line 

. . . _ -rm/r also provided several customer engineers who were eith 

instruction, xBM also provxaeu ocvc . ut of the svs tem 

on duty at the Laboratory or were on call. Thestabi y f th y 

ultimately improved so that the customer engineer staff was reduced 

single man during school hours. 






2.4, Laboratory Operation , 1966-67 



pnii scale operation with the students began on November 1, 19 66, 

The dlilv schedule is indicated in Figure 2. The starting date ^ ter 

than originally anticipated, becau-.e of a j^ ^ July 10 to 

1500 system which arrived at the Brentwood School on July 10. July 
November 1 was devoted to a shakedown and debugg ng period of the system 
which was, of course, untested in on-line operation. 



_ 4 q children from two of the first-grade 

2 the X CM Classroom. Each class was 

La^or f on 5 g =ef . 

to^each°child, SU w^f^d’ t&fn S3T-W 
counting skills. They were tutored individually throughout the month 

of October, 



time on tte’^rgJo^d^ithl ^ych^ogist^Dr^Rivka Eifennann^of the 
Hrtrew UniversUy, Jerusalem, Israel) who taught them simple games 

jss. «• Wf "“-“rrf 

“r.rr.miS 1 ..);”:";.". .» - .»« «■* ■- »■» * — 

of what a set was. The results were not conclusive. 



During the week of October 2i, five children from each group were 
taken out of the classroom each day for individual testing. The tests, 

ss u- 2 «a.. 

SSfSTAS SS4I «ii.w ■“““ •* 



culturally disadvantaged children. 



0. 0— 87. a-; «- ~ 



1 .. P r, rhinn W. G, • and Dunhley, M, B, The special 

^ iifSct’ Pilot program on mathematics learning of culturally 
d isadvantaged°pr imary schoo? children. School Mathematics Study Group 
Reports, No. 2, 1966, Stanford University. 132 PP« 
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half remained in the classroom with one of the teachers. In the terminal 
room, each child was assigned a proctor who helped him get started, and 
who monitored the entire lesson which lasted from 3 "to 5 minutes. All 
children were faded^ after the first lesson. 



On November 1, children in Groups I, II, and III did the first 
lesson under the close supervision of a proctor. On that same day the 
children in Group IV worked Aram 15 to 17 minutes. The seven proctors 
did not monitor these children, but observed them as they worked. The 
children were attentive throughout and did not seem to tire of the work< 
At the end of the 15 minutes, one child had nearly completed Book 1, 
During this period, however, proctors detected some errors which were 
especially confusing to children new to machine work, (in one case, an 
audio tape ’’ran away" and played on, independent of the problems being 
solved. In a few cases, the computer mistakenly identified a correct 
answer; as incorrect.) Because of these errors it was decided that the 
children should report to the terminal room in groups of 7 or less so 
that each child could be monitored by one of seven proctors until the 
error problem was minimized. 



On November 7, a regular terminal- room schedule was established,, 
Groups continued to be divided into two 10-minute periods, with seven 
proctors each assigned to listen with one child. An additional proctor 
took care of the proctor typewriter and loaded audio tapes at the 
beginning of the day or whenever a child transferred from one book to 
another. The fade command allowed each child to finish his lesson and 
to return to the classroom before the 10-minute period was over 0 



By November 9 > most children could start their lessons without help 
from a proctor. Those who could not start their program alone usually 
waited for a proctor's go-ahead, not because they did not know how, but 
because they either wanted attention or were reluctant to begin without 
an authority's approval. 



If a child failed to meet the established criterion for a lesson, 
his proctor, responding to instructions typed on the proctor typewriter, 
assisted him, recording all pertinent information on a special sheet 
which was turned over to the master proctor at the end of the day. Notes 
from these sheets were used to inform classroom teachers of each student's 
progress and as aids for revision of the material. 




On December 12, only three proctors were assigned to the terminal room; 
two proctors provided individual help while a third supervised the entire 
room and dealt with discipline problems. A fourth proctor's duties 
included changing audio tapes and dealing with minor systems difficulties. 
Each child was assigned a permanent station, and the groups were no 
longer divided into two periods. Seven to 10 children worked on-line from 
12 to 15 minutes; fade time was standardized by the clock to assure that 



L The FADE command, which is input by a proctor, caused a student 
station to be signed off as soon as the student completed the current lesson* 
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all children were hack in the classroom by a specified time 0 Two to 4 
children remained in the classroom each day on a rotating basis, thus 
allowing more time and space for valuable classroom instruction and 
activitieso The revised schedule proved satisfactory for both the proctors 
in the terminal room and the classroom teacher 0 

Reading, During the period from the opening of school in September^ 
to mid-October, the program of pretests begun in the spring was completed 
by Dr. Lucille Mlodnosky, 

The students began going to the Laboratory on a daily basis on 
November 1, During a week of orientation in the off-line teaching room, 
the students were acquainted with the use of the earphones, microphone, 
and light pen. Exercises and games were used to familiarize them with 
the equipment and the kinds of learning tasks they would encounter in 
the terminal room. During the second week in November, they were 
introduced gradually to the actual response terminals on a staggered basis; 
that is, a lesson in the terminal room was followed by a lesson in the 
off-line teacher room. By November 15, the students were on the system 
daily for a 20-minute instructional period. During these early exposures 
to the terminal equipment, an adult was stationed behind each child to 
assist him with problems in handling the equipment. The childreit 
adapted quickly to their new environment, and the adults were gradually 
withdrawn. By mid-November, the proctor staff within the terminal room 
consisted of one teaching proctor, one machine proctor, and a remedial- 
reading teacher. 

The students went to the Laboratory in four groups, since the terminal 
room was equipped to accommodate only one half of a normal classroom at 
a time. Each group was given 20 minutes of instruction, A min im u m 
10-minute interval was scheduled between groups to prepare the system 
for the next group. Each student was signed-on at a response terminal, 
and the appropriate films and audio tapes were loaded into the projectors 
and audio-drive units. When the sign-on process was completed, the name 
of the student assigned to a given terminal appeared on the CRT, 

As each group arrived at the terminal room, the students entered the 
room, seated themselves before their assigned terminals, put on their 
earphones, touched their names with the light pen, and began the lesson. 
During the instructional session, the machine proctor was stationed at 
a proctor’s typewriter that transmitted messages from the central system. 
These messages consisted primarily of identification of a system or 
terminal failure, transfer of a student from one lesson to the next, or 
notification of an error limit exceeded at some terminal. In the case 
of a system or terminal failure, the machine proctor took appropriate 
action, which ranged from transferring a student to an empty terminal to 
notifying the head systems programmer. When a student transferred to a 
new lesson, the machine proctor changed his audio tape. Each block o 
problems within a lesson had an error limit of 50 per cent of the total 
number of problems within the block. If the error limit was exceeded by 
the student, notification was transmitted to the machine proctor, who 
in turn conveyed the information to the teaching proctor. 
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The teaching proctor observed the student and chose between two 
courses of act ion . If the difficulty appeared to be mechanical (e„go, 
incorrect use of light pen) or a minor misunderstanding of directions or 
lapse of attention, the teaching proctor signed on the terminal with the 
student and helped him through the troublesome section,, By signing on 
the terminal, a proctor bit was set in the response record to identify 
responses which were not necessarily those of the student , If* however, 
the student's difficulty appeared to be of a serious nature, the proctor 
removed the student from the terminal and transferred him to the remedial 
teacher for diagnosis and personal instruction in the off-line teaching 
room, Fortunately, during the entire year's run the necessity for such 
off-line instruction was infrequent. The remedial-reading teacher 
functioned primarily as an assistant to the teaching proctor within the 
terminal room and was brought into play in her major function only when 
the system was down or an individual terminal failed. 

The population of the first-grade classroom was somewhat smaller 
than anticipated, which left terminals unoccupied for each of the four 
groups » During the early phases of the program this arrangement was 
fortuitous since spare terminals were available in case of terminal 
failure. After Easter vacation, however, the stability of the system 
improved enough so that it was no longer necessary to maintain a large 
number of backup terminals. Remedial second-grade students then were 
run on the newly available terminals. The second-grade teachers reported 
a definite increase in interest and application to the reading task o 
the remedial students within the classroom, 
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Mathematics, On September 18, a staggered-day schedule began in 
the primary Fa d e s, and students reported to the Laboratory for mathematics 
instruction. Two days were spent testing and establishing routines and 
schedules, and on September 20, the students started the programmed 

lessons. 

By September 29, after eight days of CAI instruction, the fastest 
child had completed 5-1/2 books (62 lessons) , while the slowest child had 
completed 2 books (25 lessons) , 

Reading, On September l8 and 19i 1967 > 79 Brentwood ^^"Syade 
students were introduced to computer-assisted instruction in i^ial 
reading. While a remedial teacher worked with the remaining children, 

2 students worked at a student terminal using the light pen and earphones. 
All children were familiar with the terminal equipment by September 20, 
when they began work on Days 1 and 2, the introductory lessons, 

Proctoring procedures were modified as the need for adult supervision 
in the terminal room on a one-to-one basis diminished. Only ree a ® 
were present in the terminal rooms the head proctor, the machine proctor, 
^ u on-line proctor. In addition, a certified remedial teacher was 
always present in the teaching room of off-line remedial work. 





On September 25, the students began Day 3, «hich «°^ed of 
Read T-93 and 1-94, the letter- teaching lessons. On September 29, 
after the ttrst leek of instruction, the students were distributed as 



follows 



Lesson 


Number of 


Day 3 


42 


I- 01 


2k 


1-02 


10 


1-03 


3 




79 



13 














Chapter 3 



The Curricula 



3.1, Mathematics 



The 400 lessons in the first-grade mathematics program covered the 
ordinary range of first-grade arithmetic topics, such as counting, 
numerals, addition, subtraction, and linear measure, as well as a few 
topics less commonly found in first grade, namely, sets and set notation, 
and congruence of plane figures. The content and scope of the curriculum 
were drawn largely from Sets and Numbers , Book 1 by Patrick Suppes, with 
the addition of some topics, such as oral story problems which cannot, by 
their nature, be adapted to a textbook format 0 



Since the programmed lessons were tutorial, many of the lessons were 
explanatory, relying on oral explanations synchronized with changing 
visual displays. The average lesson contained fewer than 10 problems, 
and explanations were simple and direct. Generally, the problems within 
one lesson were all of the same type; the first few were accompanied by 
explanatory audio messages and the remainder were practice problems. 



Both explanatory and practice problems contained provisional audio 
messages which were heard only by students who responded incorrectly 
or failed to respond within a reasonable time. As an example, for the 
first problem in Lesson 6GL, the data showed that 44 out of 49 students 
chose the correct answer. Three students made no response within 20 
seconds and heard, "Which set below has two members?" The two students 
who responded incorrectly saw a sad face and heard the audio message, 
"Point to the box next to the set with two members. After this negative 
reinforcement routine, they were given a chance to respond again, and 
both responded correctly. 



For this problem, as for most problems throughout the curriculum, 
students were allowed three chances to produce the correct answer. 

After three incorrect responses, the correct answer (or an arrow pointing 
to the correct choice) was displayed, accompanied by a brief audio 
message. Moreover, a 20-second time limit was set for every problem, 
and when that limit was reached, an additional hint was given 0 If a 
student did not respond within 40 seconds, the answer was displayed. 

In any case, the student was required to make the correct response before 
the program continued to the next problem. 



Lesson 6GL was taken by 49 students with 4l to 46 initial correct 
responses on the 13 problems. As was to be expected, problem 2 (the 
empty set) was the most difficult since it had no accompanying oral 
instruction. The average response time was 6 seconds, and no student 
failed to respond within the 40- second time limit. 



‘Suppes, P, Sets and Numbers , Book 1, New York? Singer, 19^5 < 
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For the practice problems, the last nine problems of the lesson, 
the number of initial correct responses made by each student was 
accumulated and compared to a preset criterion,, In this lesson, the 
students were expected to answer 7 of the 9 problems correctly (other 
possible criteria? 5 out of 6, 6 out of 8, 8 out of 10, etc*)* As soon 
as a student made the required number of correct responses (in this 
case, 7), he was allowed to skip the remaining problems and to begin the 
next lesson* On the other hand, if a student missed any three of the 
nine problems, he clearly failed criterion and was branched immediately 
to the remedial lesson, bypassing remaining problems in the lesson,, 

In Lesson 6GL, there were four students who failed to meet the 7 ou t of 
9 criterion,, They received immediate remedial material in the form of 
a lesson containing the same kinds of problems, but with a slower 
development of the ideas using simpler vocabulary and sentence structure* 



Later in the year as the concepts of counting and addition were 
e' tmilated, students were required to give constructed responses using 
^ - keyboard* Slightly more than one fourth of the lessons required 
typed responses* Regular drills with problems of varying degrees of 
difficulty were provided. In order to adapt the curriculum to individuals 
the drills were usually written on five levels of difficulty with 
branching decision based on individual records* The lessons were grouped 
in books containing from 9 to 3^ lessons* 

The amount of material contained in remedial branches was a major 
factor in the rate of student progress through the curriculum* With 
the exception of several children who entered school late in the year, 
ai i students began programmed instruction in Book 1 on October 27 , 19&o* 
Table 1 shows the books in which students were working at the end of 
the school year* 



TABLE 1 

Book No* 10 17 18 19 20 21 22 23 2k 25 

No, of students 1* 7 5 k 12 2 10 3 6 2 

*This student received classroom instruction during 
the latter part of the year* 



Content of programmed lessons * The topics covered included the 
followings 

1* Sets* Concept of a set and member of a set, description of 
sets by naming a common property, description by enumeration, use of 
set braces, empty set, equality of sets, union of sets, solving set 
equations, equivalence of sets, use of N-notation as a pro-numeral, 
construction of equivalent sets, difference of sets, subsets* 




•f-nr-. •X'-'*- ■»* rr~ *' i »r nfits.-3.Sr4V^^«5^ T* * ' ! r-tfHY- - '»-'/« . :^ -■ 







2 0 Numerals and counting. Numeral recognition, counting objects 
in arrays, counting randomly arranged objects, counting members of sets 
using N-notation, successor, predecessor, counting by two's, counting 
by five's, counting by ten's, counting by ten's and one's, place value, 
place value related to dimes and pennies, more and less, number line, 
oral story problems. \ 

3, Addition. Concept of addition using N-notation, equations, 
column addition, commutativity, three addends, solving addition equations 
(one missing addend), construction and use of addition tables, oral story 
problems with and without pictures to count. 

4, Subtraction. Concept of subtraction as "take-away," equations, j 

column subtraction, subtraction as the inverse of addition, oral story | 

problems. j 

5o Geometry. Recognition of figures (square, circle, triangle, J 

rectangle, line segment), concave and convex, open and closed, inside | 

and outside, congruence with rotations and reflections, similarity with J 

rotations and reflections, construction of rectilinear figures given j 

vertices, counting sides and vertices, linear measure. j 

6, Games. "Reward" games used primarily for motivation. j 

a’ 

% 

7, Miscellaneous. Ordinals, liquid measure, time, readiness for j 

fractions, number words. f 



Classroom work. The activities carried out in the classroom 
included % (a) use”of physical objects to introduce concepts presupposed 

by the programmed lessons; (b) work originally planned as programmed 
lessons; (c) remedial work for individual children; and (d) enrichment 
material for individual or groups of children. A discussion of classroom 
activities follows. 

Introduction of concepts presupp osed by the programmed lessons . 

From September 30 until the first group began programmed instruction on 
October 27, the four different groups met in the Laboratory classroom 
each day for approximately 20 minutes. 

The activities carried out in the classroom were intended to give 
the children a variety of manipulative experiences which the programmed 
lesson presupposed. At the same time it was important to exercise care 
that no tasks introduced in programmed lessons were first introduced in 
the classroom setting, since this would make meaningless any data 
collected from the programmed lessons. 

We began by doing exercises in one-to-one correspondence. (Since 
knowledge of counting was to be tested during the first month of school, 
reference to number in this exercise was strictly avoided.) An example 
of the kind of activity done was to hold up a given number of pencils 
and to instruct the children, "make yours look just like mine 0 The 
terms "as many as" and "the same number of things as" were also introduced. 
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The tasks ranged in complexity from the simple task of matching like 
objects one-to-one through three intermediate stages to matching pictures 
of unlike objects one-to-one. The amount of practice necessary at each 
of the intermediate stages was determined to a great extent by the 
children's ability or lack of ability to count, (Though no mention of 
counting was made, those children who already knew how to count 
immediately chose this method of solving their problems,) When three 
or fewer objects were involved, mistakes were uncommon. When four or 
five objects were involved, errors increased, and when more than five 
objects were involved, errors were quite common. Methods of correcting 
or verifying answers were devised by the children. 

These activities led to a development of the concepts of more and 
less. Few children had any difficulty with the concept of more , but 
almost every child had trouble with less . The word "less” seemed completely 
unfamiliar to many children, and even when stressed as being the opposite 
of ’’more” or as meaning "not as many as," "less" was the most difficult 
word introduced to the children. 

Another concept the children needed to understand in order to do 
some of the progr amme d lessons was that of giving yes or no answers to 
questions. As might have been expected, questions requiring yes answers 
were quite easy, while those requiring no answers were considerably 
more difficult. 



Exercises using the words top, middle, bottom, before, and after 
were given, since knowledge of these words was presupposed in some of 
the machine lessons. There was little difficulty with these words in 
the limited contexts in which they were used. 

After the children had been tested, they were introduced to counting 
through 5> and later to counting through 9» There was considerable 
discrepancy in the abilities of most children to rote count and in their 
abilities to "Show me seven blocks," or to give an answer to How many 
blocks do I have?" The slower children required a period of several 
weeks to develop their ability to count to 9<» 

The more advanced children were able to generalize that (a) we need 
1 more to make the next number; and (b) a number is 1 more than the 
number before it. Many exercises in completing patterns were necessary 
before those generalizations were made. 

The children also worked on concepts of the same , more , and less 
when comparing two groups of objects. All of these activities were done 
using manipulative materials. 

Sets of objects were introduced, as was the concept union of sets . 
Both topics were introduced using manipulative objects, and no notation 
was used in these exercises. Considerable attention was given to 
identifying sets as having particular properties in common, leading up 
to identifying sets with the same cardinality. The children had no 
difficulty with the concept of the empty set , as long as it was referred 
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to as "the set with nothing in it 0 " The word "empty," however, was 
unfamiliar to almost all these children, and seemed to he a somewhat 
difficult one for the children to learn 0 Thus, reference to "the empty 
set" increased the difficulty of tasks involving the empty set. 



Linear measure was introduced in the classroom, first using non- 
standard units, and later using standard units 8 Most of the children 
had no idea of how to make a linear measurement. 
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Telling time to the hour, recognizing various coins, and counting 
money were also introduced in the classroom. 

Considerable attention was given to writing the numerals, and late 
in the year, to writing number sentences. In general, the writing of 
number sentences was done in connection with story problems given orally. 

Work originally planned as programmed lessons . Several times during 
the year, children remained in the classroom while further programmed 
lessons were prepared. 

During one such period, the groups worked on addition, since this 
had just been introduced by programmed lessons. The introduction was 
without any direct reference to manipulative objects, and most children 
were having considerable trouble. The classroom activities were concerned 
with using manipulative objects to illustrate addition, and with relating 
such manipulations to the symbols. The obvious need of children to count 
in order to solve addition problems led us to provide a wire with 10 beads 
for each child to use either in the classroom or at his terminal. As the 
children learned the various combinations, they used the beads only for 
those combinations they still did not know. 

We also played a number of games leading to providing the missing 
addend. As long as the games were played orally without showing the 
addition sentence, almost every child: could answer correctly. When 

the number sentence was written on the chalkboard to be read by the 
children, however, errors increased dramatically. This was true even for 
those children who could read the equations. Apparently they still were 
not comfortable relating written symbols to physical experiences. 

At another time it was decided that the topics in Books 11, 12, 
and 13 should be taught in the classroom, while succeeding books were 
being programmed. Topics included in this classroom work were (a) more 

addition (both a + b * , and a + = c)j (b) number sequences^ and 

(c) introduction to the number line. 

Remedial work. The most frequent topics for which children were 
sent to the classroom were addition and subtraction. Throughout the year, 
whenever a child had excessive difficulty with a topic he encountered in 
programmed material, he was sent to the classroom for remedial work. 

The time spent with a teacher varied from a few minutes to several days, 
depending on his needs. 




